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Abstract 

We study Derrida's generalized random energy model in the presence of uniform external field. We com- 
pute the fluctuations of the ground state and of the partition function in the thermodynamic limit for all 
admissible values of parameters. We find that the fluctuations are described by a hierarchical structure 
which is obtained by a certain coarse-graining of the initial hierarchical structure of the GREM with ex- 
ternal field. We provide an explicit formula for the free energy of the model. We also derive some large 
deviation results providing an expression for the free energy in a class of models with Gaussian Hamil- 
tonians and external field. Finally, we prove that the coarse-grained parts of the system emerging in the 
thermodynamic limit tend to have a certain optimal magnetization, as prescribed by strength of external 
field and by parameters of the GREM. 
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1. Introduction 

Despite the recent substantial progress due to Guerra [[l6|], Aizenman, Sims and Starr ^, and Tala- 
grand [ p4| ] in estabhshing rigorously the Parisi formula for the free energy of the celebrated Sherrington- 
Kirkpatrick (SK) model, understanding of the corresponding limiting Gibbs measure is still very limited. 

Due to the above mentioned works, it is now rigorously known that the generalized random energy 
model (GREM) introduced by Derrida [ p^ ] is closely related to the SK model at the level of the free energy, 
see, e.g., |^ Section 11.3]. Recently the first author and Kurkova ^ U have performed a detailed study 
of the geometry of the Gibbs measure of the GREM. This confirmed the predicted in the theoretical physics 
literature hierarchical decomposition of the Gibbs measure in rigorous terms. 

As pointed out in (see also [^), the GREM-like models may represent an independent interest in 
various applied contexts, where correlated heavy-tailed inputs play an important role, e.g., in risk modehng. 
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One of the key steps in the resuhs of is the identification of the fluctuations of the GREM partition 
function in the thermodynamic limit with Ruelle's probabiHty cascades. In this paper we also perform this 
step and study the effect of external field on the fluctuations (i.e., the weak limit laws) of the partition func- 
tion of the GREM in the thermodynamic limit. We find that the main difference introduced by the presence 
of external field, comparing to the system without external field, is that the coarse graining mechanism 
should be altered. This change reflects the fact that the coarse-grained parts of the system tend to have 
a certain optimal magnetization as prescribed by the strength of external field and by parameters of the 
GREM. We use the general line of reasoning suggested in [^, i.e., we consider the point processes gener- 
ated by the scaling limits of the GREM Hamiltonian. We streamline the proof of the weak convergence of 
these point processes to the corresponding Poisson point process by using the Laplace transform. 



Organization of the paper. In the following subsections of the introduction we define the model of in- 
terest and formulate our main results on the fluctuations of the partition function of the random energy 
model (REM) and GREM with external field and also on their limiting free energy (Theorems 0, ^ 
and p4[ ). Their proofs are provided in the subsequent sections. Section ||is devoted to the large deviation 
results providing an expression for the free energy for a class of models with Gaussian Hamiltonians and 
external field (Theorem |ll.l| ). In Section [ll| we resort to more refined analysis and perform the calculations 
of the fluctuations of the ground state and of the partition function in the REM with external field in the 
thermodynamic limit. Section |^ contains the proofs of the results on the fluctuations of the ground state 
and of the partition function for the GREM with external field. 



Definition of tlie model. Derrida's GREM was proposed as a mean-field spin-glass model with a Gaussian 
Hamiltonian and hierarchical correlation structure. In this paper, we consider the GREM with uniform 
external (magnetic) field. In contrast to the work of Derrida and Gardner [pj[], we consider here the model 
with the external field which depends linearly on the total magnetization (i.e., the uniform magnetic field). 
The authors of considered the "lexicographic" external field which is particularly well adapted to the 
natural lexicographic distance generated by the GREM Hamiltonian. 

GivenA^ E N, consider the standard discrete hypercube 1.^ = { — 1; l}'^- It will play the role of the index 
set. Define the (normalized) lexicographic overlap between the configurations cj'^' , ff'^' G Y-n as 

(1) (2) ^/O: (Tl'^^CrP) 

^'^^'^ ^" j^max{fce[l;A^]nN:[(T(i)],= [(j(2)],}, otherwise. 

We equip the index set with the lexicographic distance defined as 

dL((7('),(T(2))^l-^L((TW,(Tp)). 

This distance is obviously an ultrametric, that is, for all a''', a'^\ a'^' € Eat, we have 
dL(cT(^aCT)<max{dL((T(^a(2)),dL((T(2),(T(3))}. 

Throughout the paper, we assume that we are given a large enough probability space P) such 

that all random variables under consideration are defined on it. Without further notice, we shall assume 
that all Gaussian random variables (vectors and processes) are centered. 

Let GREMa? = {GREMi\i{a)}aeZN be the Gaussian random process on the discrete hypercube Eyy with 
the covariance of the following form 



E 



GREMa,((7"')GREMa,(c7(2)) =p(^l((t('',c7(^')), (2) 



(') .t(2)^ 



where p : [0; 1] ^ [0; 1] is the non-decreasing right-continuous function such that p(0) =0 and p(l) = I. 
Given h E IR+, consider the Gaussian process X = Xn = {XM{h, ct)}ctgi,v defined as 



h ^ 

XN{h, a) = GREMa,((j) + ^ ^ a,-, cj e Ea,. (3) 
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The second summand in is called the external field. The parameter h represents the strength of external 
field. Denote the total magnetization by 

1 ^ 

mN{a) = - 12 ^ ^ ^N- (4) 

■'^ 1=1 

The random process induces the Gibbs measure '^N{l5,h) G ^i(Ea?) in the usual way 

^^(/3,/j)({(T}) ^ exp [j3 v^X^ (J3-1/2, a) 

where the normalizing constant ZAr(/3) is called the partition function Z^iP ^h) and is given by the following 
sum of 2^ correlated exponentials 



(j3 , /i) = ^ exp [j3 VnXn {h, a) 



(5) 



The real parameter )3 > is called the inverse temperature. The important quantities are the free energy 
defined as 

p^(j3,/i) = ilogZ^(/3,/z), (6) 

and the ground state energy 

Mn (h) = N-^/^- max Xn{Ii, a). (7) 

In what follows, we shall think of )3 and h as fixed parameters. We shall occasionally lighten our notation 
by not indicating the dependence on these parameters explicitly. 

In this paper we shall mainly be interested in the weak limit theorems (i.e., fluctuations) of the partition 
function (||) and of the ground state as | +°°. To be precise, the general results on Gaussian concentration 
of measure imply that and are self-averaging. By the fluctuations of the ground state, we mean the 
weak limiting behavior of the rescaled point process generated by the Gaussian process (Q). This behavior 
is studied in Theorems and [.2 below. These theorems readily imply the formulae for the limiting free 



energy (^) and the ground state (|7|). A recent account of the mathematical results on the GREM without 
external field and, in particular, on the behavior of the limiting Gibbs measure can be found in . The 
GREM with external field was previously considered by Jana and Rao [ jl9| ] (see also ijl^), where its free 
energy was expressed in terms of a variational problem induced by an application of Varadhan's lemma. 
In this work, we apply very different methods to obtain precise control of the fluctuations of the partition 
function for the GREM with external field. As a simple consequence of these results, we also get a rather 
explicitjj formula for the limiting free energy in the GREM with external field (see Theorem |L4|). 

Main results. In this paper, we shall consider the case of the piece-wise constant function p with a finite 
number of jumps. Consider the space of discrete order parameters 

= : [0; 1] ^ [0; 1] | ^(0) = 0,^(1) = 1,^ is non-decreasing, 

piece-wise constant with « jumps}. (8) 

Recall the function p from (^. In what follows, we shall refer to p as the discrete order parameter. Assume 
that p € In this case, it is possible to construct the process GREMa? as a finite sum of independent 
Gaussian processes. Assume that 

u 

k=l 

where 

<xi < ... <x„ = 1, (10) 
= qQ<qi<...<q„ = l. (11) 



In contrast to Jana and Rao 




Theorem 5.1] and Jana flla, Corollary 4.3.5], who stop a the level of variational problem. 
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Let {flA:}^=i C IR be such that fl| = qi^ — qk-i- We assume that, for all ^ e n N, we have xj^N e iNj^ and 
also fl^. 7^ 0. Denote Axi = x/ — 

Consider the family of i.i.d standard Gaussian random variables 

. . . , I G [1;«] n N, (jO G I,,;v, . . . , (t(^) g E,,^}. 

Using these ingredients, for a = a'*' ii cj'^'' ii . . . ii cj'"' G T-n, we have 

GREM^((T) ~ f fl,X((j('), . . . ^(jW). (12) 

Equivalence ( |T2[ ) is easily verified by computing the covariance of the right hand side. The computation 
gives, for C7, T G 

Cov[GREM^((j)GREMiv(T)] = ^^,^(^,,). 

Limiting objects. We now collect the objects which appear in weak limit theorems for the GREM partition 
function and for the ground states. We denote by / : [— 1 ; 1] ^ IR+ Cramer's entropy function, i.e., 

I{t) = -f)log(l -f) + (1 +f)log(l +f)]. (13) 

Define 



p(f) = v/2(log2-/(f)), 
M(h)= max (p(t)+ht). (14) 

Suppose that the maximum in (|l4|) is attained at r = = f*(/?). (The maximum exists and is unique, since 
p(f) +ht is strictly concave.) Consider the following two real sequences 

ANih)=(^pit*)VNy\ (15) 

Define the REM scaling function U[^i,{x) : IR ^ IR as 

UN,h{x)=AN{h)x + BN{h). (17) 

Given / : D C IR IR+, we denote by PPP(/(x)dx:,x G D) the Poisson point process with intensity /. We 
start from a basic limiting object. Assume that the point process ^(') on IR satisfies 

^(1) ^ppp(exp(-x)djc,xG R), (18) 

and is independent of all random variables around. The point process (|l8]) is the limiting object which 
appears in the REM. 

Theorem I.l. Ifn = 1 (the REM case), then, using the above notations, we have 

(JGliv 

where the convergence is the weak one of the random probability measures equipped with the vague topol- 
ogy- 

To formulate the weak limit theorems for the GREM (i.e., for the case n > 1), we need a limiting 
object which is a point process closely related to the Ruelle probability cascade, [^^. Define, for j,k G 
+ 1] n N, j < k, the "slopes" corresponding to the function p in (^ as 

^j.k = ■ 

Xk-Xj^l 



■^This condition is for notational simplicity. It means that we actually consider instead of W the increasing sequence {WajaeN C hi 
such that | +00 as a t +°°. satisfying NaX^ e N, for all a e N and all 4 e n N. 
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Define also the following /i-dependent "modified slopes" 

0,,,(/i)^0,,,p(r,(0r;/2/,))-2. 

Define the increasing sequence of indices {//(/j)}/=o'' C [0;n+ 1] n N by the following algorithm. Start 
from Jo{h) = 0, and define iteratively 

7/(/!) = min|/e [y/_i;« + l]nN: ej,_^.j{h) > ej+\,k{h), foralU>/|. (20) 

Note that m{h) < n. The subsequence of indices (|2^) induces the following coarse-graining of the initial 
GREM 

qi{h)^qj,(h)-qj,_i(h)-, (2i) 
~e,{h) = ej,_,.j,. (23) 

The parameters (|T]) induce the new order parameter p G in the usual way 

m{h) 

Define the GREM scaling function p /, : [R ^ [R as 

m{h) 

UN,pj,ix)= ^ \q,iliy/%,^,)f,(9,{h)-'/^h)]+N-'/^x. 
1=1 ^ ' ^ 

Define the rescaled GREM process as 

GREMa,(/i, a) = M^^^p ,,(GREMAf(/j, a)). 
Define the point process of the rescaled GREM energies (on as 

Mh)^ E %Ri!M„(/,,a)- (24) 

Consider the following collection of independent point processes (which are also independent of all random 
objects introduced above) 



such that 



{^a'!....a,_, I ai,...,a,_i GN;Ze [l;m]nN} 



Define the limiting GREM cascade point process !^„i on R"' as follows 

^ V'"(«l).^i?(«2).....<U a„,_. («,„))' ^^^^ 

Consider the following constants 

/- \l/2 
7,(/j)= (0y,_„y,j , 

and define the function E^ j : R™ ^ IR as 

, . . . ,e,„) = 7i (/2)ei + . . . + %,{h)e,n- 

Note that due to (^0|), the constants {7/(/j)}"Li form a decreasing sequence, i.e., for all / e n N, we 
have 

r/(/j)>7/+i(/0- (26) 

The cascade point process (^5]) is the limiting object which describes the fluctuations of the ground state in 
the GREM. 
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Theorem 1.2. We have 



and 



almost surely and in L 



MN{h) 



^'T^ 



,de„,) 



m{h) 



^ {qi{h)x,{h)YI^M[e,{h)-'l\ 



1=1 



(27) 



(28) 



Theorem ^ allows for complete characterization of the limiting distribution of the GREM partition 
function. To formulate the result, we need the j3 -dependent threshold /(j3,/i) G [0;ot] n N such that above 
it all coarse-grained levels / > 1(15, It) of the limiting GREM are in the "high temperature regime". Below 
this threshold the levels / < l{l5,h) are in the "frozen state". Given j3 G IR+, define 

/(j3,/2)=max{/G [l;n]nN: /37/(/2) > 1}. 

We set l{l5,h) =0, if PfiW !i 1- The following gives full information about the limiting fluctuations of 
the partition function at all temperatures. 



Theorem 1.3. We have 

liPM) 



exp 



1=1 



X exp 

xZN{P,h) 



N (^log2 + logch (j3/i(l -^,,^^^_^)) +1)32 i^l-qj^ 



|R'(/i.'') 



exp 



eiifij,) 



ch2/3 (l5h{l-x. 



^/(i3,/,)(dei 



np.i') 
de 



(29) 



where the constant K{li ,h,p) depends on /3, h and p only. Moreover, K{^,h,p) = 1, if ^yi[fijj)+\ < 1 and 
K{l5,h,p)e{0-MifPYi{PM+i = ^- 

The above theorem suggests that the increasing sequence of the constants {j8/ = Y^^}'"l'i C IR+ can 
be thought as the sequence of the inverse temperatures at which the phase transitions occur: at j3/ the 
corresponding coarse-grained level / of the GREM with external field "freezes". 

As a simple consequence of the fluctuation results of Theorem 1.3 , we obtain the following formula for 
the limiting free energy of the GREM. 



Theorem 1.4. We have 



hm pN{fi,h) 



l{fi.h) 

1=1 



-1/2 



h))^ 



hxit^e, ^^^h] 



2^ 



(30) 



+ log2 + logch (^i3/!(l-Xy„p ,_,) 
almost surely and in L} . 

II. Partial partition functions, external fields and overlaps 

In this section, we propose a way to compute the free energy of disordered spin systems with external 
field using the restricted free energies of systems without external field. The computation involves a large 
deviations principle. For gauge invariant systems, we also show that the partition function of the system 
with external field induced by the total magnetization has the same distribution as the one induced by the 
overlap with fixed but arbitrary configuration. This section is based on the ideas of Derrida and Gardner 



Fix p G N. Given some finite interaction p-hypergraph {VN,Ej^'^), where Vn = n N and E^j^^ C 



(Viv)'', define the p-spin interaction Hamiltonian as 



•C7i„, CTGEat, 



(31) 



i£E, 



where 



(p) 



is the collection of random variables having the symmetric joint distribution. 



That is, we assume that, for any £('),£(^' e { — 1; + l}^'v'', and any t G IR 



exp 



i E 



1) A^'P) 



V 



/ 



exp 



i L r.er'/, 



(2) AN.p) 



V 



(P) 



(32) 



where i e C denotes the imaginary unit. 

A particular important example of (pi|) is Derrida 's p-spin Hamiltonian given by 



h 'p=l 

where {§,, .... ,^^[ is a collection of i.i.d. standard Gaussian random variables. Note that the condition 
( p^ ) is obviously satisfied. 

Given p e T^r, define the corresponding gauge transformation 7], ; Z^r ^ as 

Tp{a)i = piai, aelw. (33) 

Note that the gauge transformation ( ^3[ ) is obviously an involution. We say that a ^f-variate random function 

/ : ^ IR is gauge invariant, if, for any p £ Ea? and any (cj''', . . . , a'''') G E^, 

/(rp((7(')),...,rp((T('"))^/((T('),...,a('')), 

where ~ denotes equahty in distribution. Define the overlap between the configurations ff, ff' e Ea; as 



i=l 



Note that the overlap ( |34| ) and the lexicographic overlap (|l]) are gauge invariant. 
Given a bounded function Fn '■T.n ^ IR, define the partial partition function as 



a:\FN{(J)-q\<£ 



(^I5VnXn{(j] 



Denote 



Un^FnC^n), U=(\JUn 

N=l 



(34) 



(35) 



(36) 



(The bar in (Q denotes closure in the EucUdean topology.) Note that for the case Fn — Rn we obviously 
have 



2k 

l--:ke[0;N]nZ}, U = [-l;l]. 



Un- 



Proposition II.l ([1130). Assume thatX^ is given either by (pit) orX^ ^ GREMn. Fix some gauge invariant 



bivariate function F^ ■ E^ — > IR, and q € IR. 
Then, for all o' , x' G Y-n, we have 



z)P\^,q,e,XN,FN{-,a'))^z\,'\^,q,e,XN,FN{-X)) 



(37) 



In particular, the partial partition function (^5]) with Fn — Rn{', c') has the same distribution as the partial 
partition function which corresponds to fixing the total magnetization (Eh, i.e.. 



Z^^P\l5,q,e,XN,RN{-,(j'))-zlj'\p,m,e:, 



^ expi^pVNXNia) 

a:\m{a)—q\<e 



Remark II.l. The proposition obviously remains valid for the Hamiltonians Xn given by the linear com- 
binations of the p-spin Hamiltonians (^Tj) with varying p G N. 
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Proof. (1) If Xi^ is defined by (pl|), then (37) follows due to the gauge invariance of ( pT| ) and /^v- 
Indeed, there exists p eLn such that g' = 7p(T'). Define 

AN.p.p)^ {N.p) 
■>i —■'i P'l Pip- 

Due to the symmetry of the joint distribution of y''^ we have 

{XN{(y)}aeLN ^ {XN{<y)\j{N.p)^j{N.p.p)}aeLN 

which implies (^tJ). 

(2) If Xn ~ GREM/v, then, since Xn is a Gaussian process, to prove the equality in distribution, it is 
enough to check that the covariance of Xn is gauge symmetric. Equivalence (|7|) follows, due to 
and the fact that the lexicographic overlap is gauge invariant. 

□ 



The partial partition function ( p5[ ) induces the restricted free energy in the usual way: 

p^^'\l3,q,£,XM,FM) = ^\0gZlj'\li,q,£,XN,FN). (38) 

Given a^^\a^^^ e I-n, let 
Define 



yiv = {Cw((j,(j):(jeEw}, y=(UViv). 

The following result establishes a large deviations type relation between the partial free energy and the full 
one. 

Theorem II.l. Assutne X^ = {^A'(<7)}o-Giiv " ^ centered Gaussian process and /vv • ^ R t^f^ such that, 
for all N, Me N, all a^^\<7^^'> € T.n, and all t:^^\t^^^ e Em, 

C.,m(ct(') n n r*^)) < ^C.(a('),a(^)) + ^CM(T(^Tp)), (39) 

W(ct(" II tO) < ^f^(ct(')) + ^Fm(t(i)). (40) 

A iiwme that Cn and Fn are bounded uniformly in N. 
Then 

(1) The following holds 

PN (15, Xn,Fn) = ^ log ^ exp(l5VNXN{cj)+NFN{cj) 

p{^,X^F), almost surely and in l} . (41) 



N] 

(2) The limiting free energy p(li,X,F) is almost surely deterministic. 

(3) We have 

lim lim pl!;\l3,q,e,XN,FN)=p''"HP,q,X,F) 

£i+OAfT+~ 



:sup inf (-Xq-Yv + p{P,X,XF + YC) 



vgi/XgKjgF 

almost surely and in L} . (42) 

(4) Finally, 

p{P,X,F) = sup (p^PHl5,q,X,F)+q) . (43) 

Remark II.2. 
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(1) If there exists {const^f G IR+}/^=i such that, for all O £ E^f, 

CW((7) = constAf, (44) 

then (^|) simplifies to 

p'''^^l5,q,X,F) ^ inf {—Xq + p{l5,X,XF)) , almost surely and in . (45) 

(2) Inequality ( |4C| ) can alternatively be substituted by the assumption (see / [/^ Theorem I]) that 
Fn{g) = /(5a?((j)), where / : IR —s- R, / S C' (R), anc/ : Ea? ^ IR /i f/ze bounded function such 
that, for all o e Eat, t G Em, 

M 

+^ ' N+M ^ ' N+M ^ ' 



(3) It is easy to check that the assumptions of Proposition III are fulfilled, e.g., for 

Xn = ciGREMft, + C2SKjv^' , 

and 

f}v(.)^/l(^N(-,CT('^)))+/2fe(-,(Tf^')), 

where O^'^^ G T.^, ci,C2 G IR, and fi,f2 : IR IR, such that fi G C'(IR), /2 is convex. Note that in 
this case, due to Proposition III the free energies (^ij) and (^2|) does not depend on the choice of 
the sequence {c^'^-'l^^j C Ea?. 

Proof. Similarly to [|l^ Theorem 1] and [ [l7| , Theorem 1] we obtain (^ij). Then ( plj ) implies that 

p{P,XN,XFN + yCN) > p{p,X,XF + yC), almost surely and in l'. 

Hence, we can apply the quenched large deviation results [|| Theorems 3.1 and 3.2] which readily yield 
(0) and (0) (or (^, in the case of (@)). □ 



Remark II.3. Derrida and Gardner /|/3|/ sketched a calculation of the free energy defined in ( [41[ ) in the 

following case 

Fn ^qiandXN ^GREMn. (46) 

This case is easier than the case ^ we are considering here, since both qi and GREMaj have lexicographic 
nature, cf. (^ and ([l|). 

III. The rem with external field revisited 

In this section, we recall some known results on the limiting free energy of the REM with external field. 
However, we give some new proofs of these results which illustrate the approach of Section |l| Moreover, 
we prove the weak limit theorem for the ground state and for the partition function of the REM with external 
field. 

Recall that the REM corresponds to the case n = 1 in ([T^). This implies that the process X is simply a 
family of 2^ i.i.d. standard Gaussian random variables. To emphasize this situation we shall write REM((7) 
instead of GREM((j). 

III. 1 . Free energy and ground state. Let us start by recalling the following well-known result on the 
REM. 

Theorem III.l ^ |l]]). Assume that n = 1 and let p(j3 , h) be given by (^. The following assertions 
hold 

(1) We have 

V tR n\ /^+log2, j3<V2Ep , ^ , ... 

hm n«(p,0 = S ■ almost surely and m L . (47) 

(2) For all /3 > -y21og2 andN G N, we have 

0<E[p^(j3,0)]<j3v/21^. (48) 
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See, e.g., Theorem 9.1.2] for a short proof. Given k <E [0;N] n N, define the set of configurations 
having a given magnetization 

N 

E^,^ = {(7 e E;v : E = ^ - 2A:}. (49) 

1=1 

Lemma III.l. Set t^.N = Given any e > 0, uniformly in k e [0;A^] n IKI smc/i f/iaf 

fA-,ive [-l + e;l-e], 

we have the following asymptotics 

_ [2 2N^-Ni{tk.N) / ^ 1 \ ^ / 1 

Proof. A standard exercise on Stirhng's formula. □ 
Theorem 111.2(0). Assume that n = 1 ( the REM case ) and let p{fi Ji) be given by (^. We have 
p{l5,h) = lim pN{^,h) 

_/log2 + logch^/, + f , /3< V2(log2-/(M) ^fi. almost surely and in L\ (51) 

\i3(v/2(log2-/(f,))+/2?,), j3 > V2(log2-/(f,)) 

andtif G (— 1; 1) w a unique maximize r of the following concave function 



l + 77|- + :T7^-^l+^(p) I- (50) 



(-1;1) 9f i-^/ir + v/2(log2-/(f)). 
Proof. For the sake of completeness, we give a short proof based on (the ideas of) Theorem 

[Liog2(^)J, ^e[i;A^-i]nN 



[1.1 



Put 



Mk.^ 



1, k(^{Q,N} 



where [xj denotes the largest integer smaller than x. Consider the free energy (cf. (38)) of the REM of 
volume Mj-jv 

Pk.Nm = -^\og ^ exp(i3M;/>EM(cT; 
where REM = {REM((7)}(jg£„ is the family of standard i.i.d. Gaussian random variables. Let 



Mk.N (( N 



Note that (|52|) is the restricted free energy (cf. (^8|)) of the REM, where the restriction is imposed by the 
total magnetization (^ given by t^ ^. 

We claim that the family of functions ^= {E [pa'(-)]}a'gih is uniformly Lipschitzian. Indeed, uniformly 
in j3 > 0, we have 



dpE[iyNm=N-'/^Emii,0)[XNia)]]<N-'^^E 



maxX{a) 



^'T^ 



V21og2. 



Hence, the family ^ has uniformly bounded first derivatives. 

Given f G (— 1; 1) and f^^^ jv G Un (cf. (^) such that HmN-^^ootk^^N = t, using (^0|), we have 

Using ( ^3] ) and the uniform Lipschitzianity of the family we get 

lim pkMP) = (l-/(f)log,e)p( ^ ) . (54) 
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Combining with and (Q, we get 

p{p,h)= max ir/3/2+(l-/(f)log2e)p( ^ | I. (55) 

To find the maximum in (^5|), we consider two cases. 

(1) If i3 < ^2(log2-/(fH.)), then according to we have 

/ jg \ _ j32 

^'I^Vl-n0log2ey "'°^^ + 2(l-/(0log2e)- 
Hence, ( |5^ impHes 

p{l5,li)= max (fj3/i + ^+log2-/(f)l =log2 + logchj3/2 + ^, (56) 



rG[-l;l] [ 2 

where the last equality is due to the fact that the expression in the curly brackets is concave and, 
hence, the maximum is attained at a stationary point. The stationarity condition reads 

f = fo(j3,/2)=tanhj3/i. (57) 

It is easy to check that the following identity holds 

/(f) =ftanh"^f-logchtanh"'f. (58) 

Combining_@and@, we get (H). 
(2) If J3 > ^2(log2-/(f*)), then again by (0), we have 



p \ j3^/2l5i2 



\^l-I{t)\og2eJ Vl-/(f)log2e 

Hence, ( |5^ transforms to 

p{p,h) = max |fj3/2 + i8v/2(log2-/(f))|=j3 fv/2(log2-/(f*))+/if*), (59) 

where the last equaUty is due to the concavity of the expression in the curly brackets. 
Combining ^ and (H), we get (|l]). □ 

Remark III.l. We note that due to the continuity of the free energy as a function of ji, we have at the 
freezing temperature j3o 

to{l5o,h)--t4h). (60) 



Theorem III. 2 suggests that the following holds. 
Theorem III.3. Under the assumptions of Theorem III.^ we have 



lim — = maxXN(h, a) = ■\/2(log2 — /(f*)) +/2f*, almost surely and in l} . (61) 



Proof. We have 



],PNm < ^log [NpVNmaxXNih^a)) =^-^ + ^ maxXN{h,a). 



(62) 



In view of (pl|), relation (b3) readily implies that 



\/2(log2 -/(?*))+ /if* < lim N-^/- maxXN{h,o). (63) 

We also have 

4pA'(/3) > 4?7 maxXA,(/!,(7) 



which combined again with ( |5l| ) implies that 



V'2(log2-/(f*)) + /if* > Um N- ' /2 max Xa, (/i , a) . (64) 

N]+oo CTGliV 
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Due to the standard concentration of Gaussian measure (e.g., [ pO| , (2.35)]) and the fact that the free energy 
(^) is Lipschitzian with the constant PVn as a function of X^Qi^ ■) with respect to the Euclidean topology, 
the bounds ( |63| ) and ( |64| ) combined with the Borell-Cantelli lemma give the convergence (|6l|). □ 

III. 2. Fluctuations of the ground state. In this subsection, we shall study the limiting distribution of the 
point process generated by the properly rescaled process of the energy levels, i.e. (e3). 



Proof of Theorem I.l 



Let us denote 



(65) 



We treat ^(/i) as a random pure point measure on R. Given some test function <p G Cq"(IR) (i.e., a non- 
negative function with compact support), consider the Laplace transform of (S) corresponding to (p 



^Ui^L^''' (x+-^(A.-2.))) - f ) d. 

Introduce the new integration variables y ~Uj^ 1^ (x + (A^ - 2A:) ) . We have 



a) 



(66) 



k=0 



2n 



exp 



{N-2k)\ \Ay 



= exp<{ 

. k=0 



log 1 - 



AN{h) 



In Jr 



(l-e-'PW)exp 



N 



(67) 



Note that the integration in (67) is actually performed overy € supp^, since the integrand is zero on the 
complement of the support. It is easy to check that uniformly in y € supp (p the integrand in ( |67[ ) and, hence, 
the integral itself are exponentially small (as | +°°). Consequently, we have 



(67) = exp<^ - 



/ (l-e-'PW) 



I 

jt=0 



N\AN{h) 



exp 



Vn 



(68) 



Denote fj^ jv = 



— N-2k 



exp 



Using Lemma [II. 1 , we get 



k.N. 



1/2 



exp 



(log 2 - I{tk,N)) - ^ (uNjriy) - htk^N'/N 



(69) 



Note that despite the fact that Lemma [II. 1 is vaUd only for tk,N G [— 1 + £; 1 — e], we can still write (|69|), 
since the both following sums are negligible: 

^ AN{h) 



0< 



to*,^G([-l;-l+£]U[l-£,l]) TZ (^N{l-tlJ^ 



1/2 



exp 



A^(log2-%,^)) 



1 / 



i^{uN,h{y)-htk,N^) \ <KNexp{~LN), 



and 



'N\AN{h) 
k 



exp 



1 / 



\UNM{y)-htk.NVN 



<KNe\p{-LN). 
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Consider the sum appearing in ( p9| ) 

SN{h,y) = 2^ — 



1/2 



exp 



N (log 2 - I{tkM)) - I (uNAy) - htk.NVN 



(70) 



Introduce the functions /atj^a? ; [— 1; 1] ^ IR as 

/;v(0 = nO + ^( 



TV 



Note that definition ( p^ implies 

/'(f*) = /!p(r*). 

A straightforward computation using (p^, (|l6|) and (^Tj) gives 
/;;(r)=/"(r) + /7>0, 



2}; + log 



/"(fH.)+/l 



1 

3'+ 2lo« 



47r(l-f2)(log2-/(f,))A? 
I"{t,)+li 



O 



logN 
N 



(71) 

(72) 
(73) 

(74) 



,4;r(l-f2)(iog2_/(f^))A?^ 

Hence, since ( |73| ) vanishes even after being multiplied by VA^, ( [73| ) is negligible for the purposes of the 
asymptotic Laplace principle. This readily implies that uniformly in y G supp (p 



SN{h,y) 



N]-\ 



N 



exp [Nf Nit* 



Using ([72|), ( |73| ) and ( |74| ) in the rh.s. of (|75|), we obtain that uniformly in y G supp^ 



SN{h,y) ^^r- exp(-y). 



Finally, combining ( |76| ) and (|69|), we obtain 

^lim L^,(,) ((p) = exp I - (l - e-^M) e->'dy| . 



(75) 



(76) 



(77) 



The rh.s. of ( |77[ ) is the Laplace transform of PPP (e -''dx,x G IR). Then a standard result implies the claim 

(H). □ 

IIL3. Fluctuations of the partition function. In this subsection, we compute the weak limiting distribu- 
tion of the partition function under the natural scaling induced by (p^. Define 



CA,(j3,/i) =exp j5M{h)N^ 
£)Ar(/3,/t) =ch"2/^(j3/2)exp 



■log 



I"ih)+h 



2pih) ^\47til^t^)(log2-I{h))N 



( log2 + logchj3/2 



Pit* 



Theorem III.4. ///3 > p{h), then 



> e 



//)3 < p(f*), then 



Civ(j3,/2) A'T+~ Jr 
ZN{P,h) 



DN{l5,h) iVT+» 

Proof. This is a specialization of Theorem which is proved in Section IV. 2 



(78) 
(79) 
(80) 

(81) 

(82) 
□ 
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IV. The GREM with external field 



In this section, we obtain the main results of the paper concerning the GREM with external field. We 
prove the limit theorems for the distribution of the partition function and that of the ground state. As a 
simple consequence of these fluctuation results, we obtain an explicit formula for the free energy of the 
GREM with external field. 

IV. 1 . Fluctuations of the ground state. As in the REM, we start from the ground state fluctuations (cf. 
Theorem jTlj ). The following is the main technical result of this section that shows exactly in which situa- 
tions the GREM with external field has the same scaling limit behavior as the REM with external field. 

Proposition IV.l. Either of the following two cases holds 
(1) Ifforalll£[2;n]nK 

\og2-I{t,{d-,l'\)) 



log2-/(f*(/i)) 



then we have 



(2) If for all I e [2, 



u 



,n nt 



'l,n, 



iog2-/(f,(e,;'/'/t)) 

log2-/(r*(/i)) 
and there exists (at least one) Iq G [2;n] H iNl 

\og2~i{t4e-Jfh)) 

log2-/(r,(/7)) 
then there exits the constant K ~ K{p,h) G (0; 1) such that 



01 



PPP{Ks--\xeR). 



o"G£iv 



Remark IV.l. If condition ( p5l ) is violated, i.e., there exists Iq G [2;n] n N such that 



\og2- i{t,{e-^J^h)) 



(83) 
(84) 

(85) 

(86) 
(87) 

(88) 



log2-/(f*(/i)) 

then the REM scaling (cf. (tt9b, (UThj is too strong to reveal the structure of the ground state fluctuations of 



the GREM. Theorem 1.2 shows how the scaling and the limiting object should be modifled to capture the 
fluctuations of the GREM in this regime. 

Proof. (1) Denote Nt = Ax/N, for / G [l;n]. We fix arbitrary test function (p G C^(IR), i.e., a non- 
negative function with compact support. Consider the Laplace transform Lg^^j^-^ {(p) of the random 
measure S'N{h) evaluated on the test function <p. 



E 



(TGliV 

n exp(-(9oM^)j(XA,(/i,(j)) 



(89) 



Consider also the family of i.i.d standard Gaussian random variables 

{X ((J« , ct(2) , . . . , c7(«) ) I / G [1 ; n] n N , (jC) G E«„ . . . , a'"' G } . 
Given / G n N and y G R, define 



LNil,v) = E 



n 



exp 



(_^-(pou^\{v + aiX{a^'y) + 



'(l-A-,_l)W 
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. . . + fl„X(c7('), . . . , aW) + -x,_i)V^m(c7«, . . . , aW)))] . (90) 

We readily have 

L^„(,,)((p)==L^(l,0). (91) 
Due to the tree-like structure of the GREM, for /e[l;« — l]nlH,we have the following recursion 



LNihv)^ Yl E LN{l + l,v + aiX + hAxiVNm{G^''^)) 

where X is a standard Gaussian random variable. Introduce the following quantities 

YN{h,y,v,t,l) EE UNj,iy)~h{l ~xi_i)VNt~v. 
We claim that, for any I G [l;n] n N, uniformly in v e IR satisfying 

v<Vn (M{h) -5- {I- qi-i)p{h) - h{\ -x,_i)f*(0,;„^/^/i)^ 

we have 

logLAf(/,v) ~ = > ' ' 



(92) 



X / (l-e-'P(>'))exp 



1 



dy 



(93) 



We shall prove (B3]) by a decreasing induction in I starting from I = n. 



(2) The base of induction is a minor modification of the proof of Theorem 1.1. By the definition 
and independence, we have 



k=Q 



LN{n,v) = p|( Eexp -{(p o Uf^l^){anX + hAxnVNtk^N,, + v) 



(94) 



For fixed ;te [0;A^„]nZ, 



E exp (^-{(po Uj^jJ {a„X + hAx„VNtk^N + v 

= (27r)"5 / djcexp ~x'^/2- {(pou^\){a„x + hAx„VNti,N + v) 
We introduce in (^Sj) the new integration variable 

Using the change of variables (Bq), we get that the r.h.s. of (psb is equal to 



AN{h) 



dyexp 



'2Ka„ JR 
Combining (M) and (|97|), we get 



-:^YN{h,y,v,tk^N„,n) ~ (p{y) 



(95) 



(96) 



(97) 



^,=0 ^ v27rfl„ 



dyexp 



2al 



YN{h,y,v,tk^N„,nf-(Piy) 



(t) 



:n(l-Mi /■dy(l-e-^W)exp[--Ly^(/.,y,v,r,,^„,„)2j) 



(t) 



Define 



VN{h,v,t,n) ; 



ANih) 



2na„ 



dy(l-e-'PW)exp 



2a: 



YNih,y,v,t,n) 



Given any small enough 5 > 0, it straightforward to show that uniformly in v S IR such that 

V < Vn (M{h) - hAxj, {iie;^(l) - 5) , 
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we have 



N„ 



(98) 



Indeed, we have 



exp 



< exp 



-A?„(log2~/(f„)) 



Next, using the fact that (1 - e"'''* )) e C^(IR), we get for some C > 

J^dy{l^e-'f^y'>)exp[-^YN{h,y,v,tk^N,„nf] < Cexp [-A?„ (log2 - /(f„)) 
Applying the elementary bounds 



x — x < log(l +x) <x, for \x\ < - 



(99) 



to 



An{Ii) 



2na„ JR 



1 - e "PW) exp [- ^YN{h,y, v, tk^N,, , «) 



and using the fact that, due to (pO[), there exists C > such that uniformly in e [1;A^,,] n N 



X < exp 



-2M,(log2-/(f„)) 



< e 



-CN 



we get (^8|) and, consequently, ( P3| ) holds for / = «. 
(3) For simplicity of presentation, we prove only the induction step / = « ^ / = « — 1. Due to 
we have 



LAf(n-l,v)= Y[ E LM{n,v + a„^iX + hAx„^iVNtk,, ^,N^^_^) 

k„-i=0 



(100) 



Define 



1 



Fix an arbitrary 5 > and e > 0. Due to (^3|) with / = «, there exists some C > 0, such that 
uniformly for all A:„,A:„_i with 

f,„,,„_, e {r e : \uie;^llh)-tk„,k.,_,\ < e}, 
and uniformly for all v,x e IR satisfying 



Ar„(log2-/(fi„,A,„)) <:^[M{h)-8~a„_ix 



\2 

- h{Ax„tk^^_N„ + A.Yn-lf,t„_i ,A'„_i ) j , 

we obtain 

logLN{n,v + a„_ix + hAx„_iVNtk^N„_,) < CNexp{-N/C). 

Define 

xyv(v) = —(M{h)-5-vN-'/--a„{2Ax„{log2-Iitk,M,))y'^ 

On-l ^ 

- h {Ax„tk„ ^N„ + Aa-„_ 1 fA:,__ , ,A'„_ 1 ) ) ■ 

Using the elementary bounds 

1 +jc< e' < 1 +x + x^, for \x\<l, 
and the bound ( |102| ), we obtain 



(101) 
(102) 



(103) 
(104) 



E 



^x<XN{v)}LN{n,v + an-\X + hAx„^i^/Ntk^^^i^^^) 
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wfT- P'f^ - ■^^Mj' + ^ t{x<Xf,(v)}^ogLN{n,v + an-iX + hAxn-iVNtk^_^^^_^) 
+ &{Nexp{-N/C)). 
Given A:„_i e [l;A'„_i] n N, we have 
1 



(105) 



1 /--vwli') 



exp 



ckexp 



2 2fl2 



1 -?«-2 



1 /--"^wl'') 



27r J- 



exp 



2a2 



fl2 + fl2_j 



YNih,y,v,t{k,„k„^l),n - 1) 



ck. 



(106) 



We claim that due to the strict inequaUties (^3[), we have 



1 fXN{v) 



2kJ- 



exp 



2«2 



yAr(/l,3',V,f(^„,^„_l),«- 1) 



^'T^ 



(107) 



uniformly in i' S IR such that 

v<\/n {M{h) + 5'- h{Axntk„.N„+^n-\tk„^^.,N„^, ) - {al + al_^)p{h)) = v\ 

where < 5' exists due to strict inequality (|3]), for Z = «. Indeed, due to the standard bounds on 
Gaussian tails, to show ( 107) it is enough to check that 



max 

N ' 



(108) 



for V satisfying (108). Due to (|3|) with / = n, there exists ^3 > such that we have 

(2A.^„(log2-/(f,„,;vJ))'/' <p{h) ~ 53. 
Choosing a small enough 8' > 0, we have 



(109) 



(110) 



xn{v) - 



YN{h,y,v,t{k„,k„_i),n-l) + 5VN 



il {M{h) ^vN ^l^--h {AXntk,, .N„ + ^"^n-ltk,,^ 1 M„- 1 )) 
- {al + al_,) {a„{2^x„{\og2^I{tk,„N,M'^-^] 



^ al ( {al + al_,)p{h)~ d') - (a^ + ai_,)U {2Ax„ (log 2 - /(f,„,^„ ) ) ) '/^ - 5 

(|108|) V 



(UOl 



< ( + flL 1 )p (/O - 5') - (al + 1 ) (fl2p (/,) - 5) 



= {al + al_i)(83ai + 5)-af,8' >0 



2 SI 



which proves ( p^09[ ). 

We claim that there exists C > such that uniformly in k„_\ € [l;A^„_i] n N and in y g IR 
satisfying (|108[) we have 



kn-l 



P{X >XA,(v)} < exp(-A?/C). 



(Ill) 



Indeed, in view of ( |50| ) and due to the classical Gaussian tail asymptotics, to obtain (111) it is 
enough to show that 

A^„_i(log2-%,_,.^„_J) < lx%{v^-^). (112) 



Using (108) and (103), we obtain 



(113) 



MvTl = ((fl2 + fl2_j)p(/,)_a„(2Ar„(log2-/(f,,„^J))'/2 + 5'-5) . 

If n > 2, then due to strict inequality (|3|), for / = n — 2, there exists 5" > such that we have 

(a2 + at2)pW-5''> ((log2-/(r,(0-„'/'/i)))(fl2+a2_2)(Ar„+Ax„_i))'^' 

> i2al_ 1 (log 2 - /(f,„_ 

+ (2a2Ar„(log2-/(f,„,„J))'/2, (114) 

where the last inequality may be obtained as a consequence of Slepian's lemma [ p3|] . If n = 2, then 
(1 14) follows directly from Slepian's lemma. Combining (113) and (1 14), we get ( p, 12[ ). Note that 
(1 1 1 ), in particular, implies that 



P{X>xn{v)} < exp{-N/C). 
Given A:„_i e [l;A'„_i] n N, denote 



(115) 



LAf(«- l,v,^„_i) = E 



('•-') 



Due to (|115D and (105), we have 



Ln (n - 1 , V, 1 ) = E |^(l{x<.r„(v)} + ^[x>xn{v)} )Ln {n,v + a„^iX + liAx„^i V Ntk^^_ ^ ^n„_ i ) 

= (l + E l[x<XN(v)}i-Nin,v + a„_iX + hAx„_iVNtk„_j,N„_i) 

(""-1) 

+ ff{P{X > xn{v)} +Nexp{-N/C))] . 



Using (111) and the standard bounds ( |99| ) and (|104j), we get 

. kn-l 



La?(«- l,y,fc„_i) = exp 



E 



^{x<XN (v) } log Laj (n , V + fl„_ + /i A.x:„_ i V M;t„_ i ,iV„_ i ) 



-i^'(A?exp(-A^/C)) 



Applying (107), (106), (M), for / n, we obtain 



logLAr(n- l,v,^„_l) = - 



Ajv(/z) g 

y^27r(fl2 + fl2_j)A:„=0 

X / (l-e-'PM)exp 
Jr 

+ ff{Nexp{-N/C)). 



k„) \k„-\ 



j—-YNili,y,v,tk,^,k„_i,n~iy 



dy 



Finally, we arrive at 



A',,- 1 



logLA,(«- l,v) = logLN{n-l,v,k„^i) 



2n{al + al_^)k„- 



0*:„_,=0 
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2exp(-A^/C)) 



2(fl,H«Li) 



l-e-'PW)exp 



k 



1 



2K + fl„-i) 



(4) Combining Q and @ for / = 1, we obtain 

L^^(/,)((p) =exp(^-|^(l -e-*'M)5;v(/^3')d3' + o(l)), 
where SN{h,y) is given by ([70[). Invoking the proof of Theorem LI, we get that 



(116) 



^'T^ 



exp 



e -^'dy 



= L<^(e--v)((p). 

This establishes @- 

(5) The proof of (|7]) is very similar to the above proof of (^4[). The main difference is that ( 107 ) does 
not hold. Instead, if (|6|) holds for Iq = n, then we have 

, 2' 



1 



V2nJ- 



exp 



YNih,y,v,t{k„,kn-i),n~l) 



dx 



1/2 



A? 



(117) 



««-l\/fln+fl„-l 

-(«^ + fl«-l)P(/0]|> 

uniformly in 

V < va^(m(/o - (1 -.x„_2)/«*(/20«:y^) - (fl^+fl2_i)p(/,)^ _ 5'. 

The subsequent applications of the recursion ( p2| ) to ( U? ) give rise to the constant K{li,p) £ (0; 1 ) 
in (H). 



□ 



Proof of Theorem 1.2. The existence of the r.h.s. of ( p7[) fol lows from Theorem 1.5 (ii)]. It remains 
to show convergence ( |27| ) itself. We apply Proposition [V. 1 to each coarse-grained block. Note that the 
assumption (|3|) of Proposition IV. 1 is fulfilled, due to the construction of the blocks, cf. (|2C|), (^). The 
result then follows from Theorem 1.2]. 

The representation of the limiting ground state (Go) is proved exactly as in P, Theorem 1.5 (iii))]. □ 



IV.2. Fluctuations of the partition function. In this subsection we compute the limiting distribution of 
the GREM partition function under the scaling induced by (|7|). The analysis amounts to handling both the 
low and high temperature regimes. The low temperature regime is completely described by the behavior 
of the ground states which is summarized in Theorem The high temperature regime is considered in 



Lemma 



[V.l below. 



Lemma IV.l. Assume l{P,h) ~ 0. Then 
exp 



log2 + logchj3/! + ^ 



20 



^^:(j3,/i), 



(118) 



where K{pji) = 1, ifpfiih) < I, andK{^,h) e (0;1), if^yi{h) = 1. 

Proof. We follow the strategy of Lemma 3.1]. By the very construction of the coarse-graining algorithm 
(pO|), we have 

0i,^<0i,7, =7lW^ ^e[l;7i]nN, 



0LA:<0i,7i, fce(/i;n]nN. 



Assume jS/i (/i) < 1. Hence, due to (n9), we have 



j30,'f<l, ;te[l;«]nN. 



Strict inequality (120) implies that there exists e > such that, for all k <E [1;«] H N, 
(^j32 - ^(j3 - <?A. < (log2 . 

We have 



Note that due to (C 



where 



/(f) = log2-/(f)+j3/if + j3V2, 
2 ^ 



A straightforward computation gives 

/'(fo)=j3/i-tanh-i(fo(/3,/i))=0 



gNik)) 



1/2 



^7rA^(l-f2) 
The asymptotic Laplace method then yields 

5iv(j3,/i) - ch-2/3(j3/i)exp 

iVT+~ 



1/2 



ch(/3/i). 



?2\ 1 



log2 + logchj3/j + Y 



For p < q, define 

GREM(;''?)(c7('),...,CTW)^f a,X(c7W,...,C7«). 

k=p 

Consider the event 

£w(a) = {GREMi;'''((j(i),...,a(*^)) < (fi + e)qkVN, 

foralUe [l;«]nN|. 
Define the truncated partition function as 

zr(i3,/i)= L %(a)exp[j3VA^Xw(/7,(j) 



The truncation (125) is mild enough in the following sense 



(119) 
(120) 

(121) 
(122) 

(123) 



(124) 



(125) 



E 



Z^^(j3) =5a,(j3,/0p|gREM^''''V',--->c^*^'') < eqkVN, for alike [l;«]nN| 
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A'T^ 



E[Z^(j3,/i)]. 



We write 



E[Ziv(j3)] E 



E[Z;v(j3)] E[Z^(j3)] 



(I) X (II) + (III). 



Due to (126), we get 



(II) ~ 1, (III)-^O. 
To estimate (I), we fix any 5 > 0, and use the Chebyshev inequality 

P{|(I)-l|>5}<(5E[zm(j3) 
Expanding the squares, we have 



-2 



Var 



Var 



zm(j3)l =e[z^t> 03)21 -Efz^T^(^) 



P=la(l)|i...iia(*)Gr,.j.w 



exp{2j3v^(GREM^''''V^'\ ■ ■ ■ ^c^^"^) 



+ 2piiXpmxpN{ ctW,...,(tW)^^)} 



E 

ct(''+1'ii...ii(t(«), 
T("+l)„...„t(«)Gl„_,^^,„ 
0-(p+l)_^T.(p+l) 

X (GREM);'^""^(cT 



exp|j3\/A^ 



(oREM^f +^'") (cjC) , . . . , cjf") ) + GREM^''+''"' (t'^' , . . . , T*" 
+ h{l -..p)v^(m(i_,,^)^(c7(''+') „ . . . „ (jW) +m(i_,,^)^(T("+') 

>^ l£A,((T(l)|!...lia("))%(T(')|,..,|T(")) 



Hence, due to the independence, we arrive at 



Var 



n .^N 



4^'(i3) <EE E 



p=lA=0 



(126) 



(127) 



(128) 



exp{2/3%/^v(GREMi;''' • • • 

e'" (^(1 --P)A^^ E exp(i3x/A^(GREM(;^+''"V'", . • • ,ct("') 
+ /i(l-Xp)4,(i_.^^)A,\/A^) 



(129) 



Assume that X is a standard Gaussian random variable. Using the standard Gaussian tail bounds, we have 



exp(2j3v^(GREM^'''' V', ■ ■ ■ , cr'^"^) + hxptkj^VN) 



n 

{ GREM^' ■'''( cr' .o-*'') )< (/5 v/A^} 
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= exp {A^ {2p^qp + pht,^^) }p{X>{j5-e) 
< Cexp In [215% + ^htt,N - ^ (i3 - efq,, 
Similarly to ( |l23| ), using @ and ( [l30[ ), we have 

exp (2J3 ^/A^(GREM^' c^'"' ) 

+ '"''''^-^^))^{GREM;;"V(0,...,a(/'))<(P+.),,v/lv} 

exp \n [xp{\og2 - /(f^,,-^^)) +2j32^p + 2^1vcptk,,^N - ^f'li^ | = Pn{p)- 

Using (|o|), we also obtain 

(^(1 --.)A^^ ^ exp(i8 VA^(GREM(f+''"V<^ . ■ ■ ,ctW) 
(i--v)^ , , 1 

< C £ exp{A^((l-Xp)(log2-/(f,,(i_,,,)^)) + -(l-9,)j32 



+ j3/7(l -Jr;,)fi,(l-;,„)«)} =Pa'(/7) 



Combining ( |l29| ), ( J13l| ) and ( |l32| ), we get 

Var 



JiVT+~p=i 



For any /? G [1;«] n N, we have the following factorization 



XpN / 



exp (j3 v^(GREM<;'" V\ • • • , c^'"') + /«pf^,x„wv^) 



X 



E (^(1 -^-/^)^^ exp(^ VA^(GREM^'+''"V''\ . ■ ■ ,ct(")) 



Hence, again similarly to (123), we obtain 



- c 



1 



1 



^exp<^A' Xp(log 
X £ exp A? (l-x,,)(log2-/(fi,,(i_,,,)^)) + -(l-<?p)i8 



Denote 



RNip)=qpP^ + 2xp max {log2 -/(f) + j3/if}. 
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We observe that similarly to (124) we have 



QUp) 

exp{NR{p)) NU 



Combining (n33b, (n35), (136) and (BOh, we get 



m < 



PNip)/exp{NRip)) 



C. 



< 



(136) 



< CVexp 



cY 

;tiQUp)/^Mmp)) Nf 

(i82-i(/3-e)2)^,-(log2-/(fo)> 



Pn{p) 
, f-,exp{NR{p)) 



C E exp L ((15^ - i(j3 - e f)qp - {}og2-I{u{h{xp/q, 
p= 1 ^ V 



,1/2 



A'T^ 



■0, (137) 



where the conv ergence to zero in the last line is assured by the choice of e in ( 121 ). Finally, combining 
( |l27| ) and ( [l37| ), we get 

p 



(I) 



N]-\ 



1. 



This finishes the proof of ( |l 1 8| ) in the case jifi (h) < 1. 

The case PfiW = 1 is a little bit more tedious and uses the information about the low temperature 
regime obtained in Theorem in the spirit of the proof of Lemma 3.1]. The lemma follows. □ 

Proof of Theorem [O . The proof is verbatim the one of Theorem 1.7], where the analysis of the high 
temperature regime [ 7[ Lemma 3 . 1 ] is substituted by Lemma |l V. l| . The low temperature regime is governed 
by the fluctuations of the ground state which are summarized in Theorem 1.2. 

□ 

IV. 3. Formula for the free energy of the GREM. 



Proof of Theorem 1.4. The L} convergence follows immediately from Theorem [.3 Almost sure conver- 
gence is a standard consequence of Gaussian measure concentration, e.g., (2.35)], and the Borell- 
Cantelli lemma. □ 
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